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(54) Signal processing apparatus and niethod, and image sensing apparatus 



(57) In processing an image signal output from an 
image sensing unit which includes a plurality of image 
sensing regions constructing one frame and a plurality 
of output terminals in one-to-one correspondence with 
the plurality of image sensing regions, and which out- 
puts, from each of the plurality of output terminals, an 
image signal pertaining to image sensing in a corre- 
sponding image sensing region and a dummy image 



signal concerning the con'esponding image sensing re- 
gion, offset differences between a plurality of image sig- 
nals output from the plurality of output terminals are re- 
duced on the basis of a plurality of dummy image signals 
output from the plurality of output tenninals. The plurality 
of dummy image signals are independent of electric 
charge obtained from photoelectric converters of the 'im- 
age sensing unit. 
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Description 

FIELD OF THE INVENTION 

[0001] The present invention relates to a signal processing apparatus, signal processing method, and image sensing 
apparatus and. more particularly, to a signal processing apparatus and signal processing method of processing image 
signals, and an image sensing apparatus to which these apparatus and method are applied. 

BACKGROUND OF THE INVENTION 

[0002] Fig. 16 shows the an-angement of a conventional image sensing device. 

[0003] Fig. 16 is a view showing an outline of the arrangement of a generally used CCD. This CCD primarily includes 
a light receiving unit 1 comprising a plurality of photoelectric conversion elements, optical black (OB) units 2L and 2R 
in which light-shielding members are arranged on some photoelectric conversion elements in order to prevent light 
incidence on these photoelectric conversion elements, a horizontal transfer CCD (HCCD) 4, a vertical transfer CCD 
(VCCD, not shown), and a charge-voltage conversion amplifier 5. 

[0004] A driving method of this CCD is to transfer electric charge generated in the light receiving unit 1 to the VCCD, 
and sequentially transfer this electric charge so as to read out the charge from the HCCD 4 for each horizontal line. 
The output from the HCCD 4 is subjected to charge-voltage conversion by the charge-voltage conversion amplifier 
105, and the voltage signal is output. 

[0005] Fig. 17 is a view showing the an-angement of a general digital camera. When a user operates a camera 
operation switch 101 (including, e.g., a main switch and a release switch), an overall control circuit 100 detects the 
operation and starts supplying power to other circuit blocks. 

[0006] An object image in the field angle is fonned on an image sensing device 104 via main photographing optical 
systems 102 and 103. and converted into an electrical signal by the image sensing device 104. The output electrical 
signal from this image sensing device 104 is supplied to an AID conversion circuit 106 via a CDS/AGC circuit 105, and 
converted into a digital signal pixel-by-pixel by the A/D conversion circuit 106. On the basis of a signal provided by a 
timing generator 108 which determines driving timings as a whole, a driver circuit 107 controls charge accumulation 
in the image sensing device 104, charge transfer in the horizontal and vertical directions, and the like. Also, the CDS/ 
AGC circuit 105 and the A/D conversion circuit 106 operate in accordance with the timings generated by the timing 
generator 108. 

[0007] The output image signal from the A/D conversion circuit 106 is supplied to a memory controller 115 via a 
selector 109 controlled by the overall control CPU 100, and written in a frame memory 116. This image signal written 
in the frame memory 1 16 is read out by the memory controller 1 1 5 and transferred to a camera digital signal processor 
(DSP) 110 via the selector 109. This camera DSP 110 generates R, G. and B color signals on the basis of the image 
signal supplied from the frame memory 116. 

[0008] In a state before photography, the result of processing by the camera DSP 11 0 is normally transferred peri- 
odically (frame-by-frame) to a video memory 111 to display a sensed image on a monitor display 112, thereby allowing 
this monitor display 112 to function as an electronic finder 

[0009] On the other hand, when the user designates photography by operating the camera operation switch 1 01 . an 
image signal of one frame is read out from the frame memory 116 in accordance with control by the overall control 
CPU 1 00. This image signal is processed by the camera DSP 1 1 0, and the result is temporarily written in a work memory 
113. The image signal written in the work memory 113 is compressed by a predetermined compression format by a 
compressor.expander 114, and the result is saved in an external nonvolatile memory 117 (e.g., a flash memory). 
[0010] To observe a photographed image, an image signal compressed and saved in the external nonvolatile memory 
117 is expanded by the compressor.expander 114. The result is transfen-ed to the video memory 111 and displayed 
on the monitor display 112. 

[0011] As described above, in this general digital camera the output signal from the image sensing device 104 is 
processed in almost real time and output to the memory or the monitor display 

[0012] To improve the performance of continuous shot photography or the like in the above digital camera, e.g., to 
realize a continuous shot photography capability of about 10 frames/sec, it is necessary to improve the whole system 
including the image sensing device, e.g., to increase the rate of read from the image sensing device and increase the 
rate of write of an image signal to the frame memory or the like. 

[0013] In a conventional image sensing apparatus such as a digital video camera or digital still camera using a solid- 
state image sensing device such as a CCD, as disclosed in, e.g., Japanese Patent Laid-Open Nos. 5-137059 and 
6-141246, the resolution is increased by sensing an object divisionally by using a plurality of CCDs, and obtaining a 
sensed image of the whole object by synthesizing these partial images by image processing. 
[0014] Recently, an image sensing system using a CCD composed of a few million pixels has been developed, so 
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various improvements for performing signal processing at high speed have been made. 

[0015] Japanese Patent Laid-Open No. 3-74991 discloses an image reading apparatus which uses a plurality of 
image sensing devices for divisionally reading image Information, and in which the image sensing ranges of adjacent 
image sensing devices are overlapped in the boundary, and images sensed by these image sensing devices are pasted 
5 in the boundary to obtain an image of the whole image infomnation. In this image reading apparatus, a pixel position 
having a small spatial density change with respect to a nearby pixel is detected from constituent image data. In this 
pixel position, image data forming an image sensed by one image sensingjdevice and image data forming an image 
sensed by the other image sensing device are pasted. 

[0016] However, in either apparatus in which portions of an object image are divisionally sensed by a plurality of 

10 image sensing devices and these sensed images are pasted to obtain a sensed image of the whole object as described 
above, if these image sensing devices have sensitivity differences, image density gap will be noticeable due to these 
sensitivity differences in the pasted portions (boundaries). As a consequence, an unnatural sensed image is obtained. 
[0017] Also, Japanese Patent Laid-Open Nos. 5-1 37059 and 6-141246 mentioned above disclose the technologies 
of divisionally sensing an object image by a plurality of image sensing devices. However, these references do not 

15 describe the problem of density gap in the boundaries between sensed images due to the sensitivity differences be- 
tween the image sensing devices, and hence do not disclose any method of solving this problem. 
[0018] To obtain a sensed image having inconspicuous pasted portions, Japanese Patent Laid-Open No. 3-74991 
discloses a method of improving poor image quality such as image disturbance in boundaries. Since, however, two 
partial images are simply pasted by detecting line-by-line a position at which a density change in the boundary is small, 

20 the pasting process is complicated and time-consuming. 

[0019] In addition, this method merely controls the pasting position of two sensed images for each lateral line. There- 
fore, it is difficult to effectively suppress abrupt density changes in boundaries in the longitudinal direction. In particular, 
it is difficult to effectively reduce density gap in boundaries by sensitivity differences between image sensing devices 
and thereby obtain a sensed image having inconspicuous pasted portions. 

25 [0020] As a method of improving this difficulty Japanese Patent Laid-Open No. 11-055558 proposes a digital camera 
which divisionally senses the left and right portions of an object image by two CCDs arranged such that the sensed 
images overiap each other in the boundary. These Jtwo sensed images are stored in an image memory via an analog 
signal processor and an A/D converter. After that, a shading correctorj corrects variations in the sensitivity distribution 
in the image sensing surface. Then, an image synthesizer pastes. the portions in the boundary to generate a sensed 

30 image of the entire object. 

[0021] In this method, an image of a boundary portion is generated by reducing a density difference in the boundary 
portion by perfonning processing such as average value calculation: A sensed image Is generated by synthesizing this 
boundary image and the left and right images excluding the boundary image. However, an optical image of an object 
must be supplied to a plurality of image sensing deyices after being divided into a plurality of images partly overlapping 

35 each other. A three-dimensional space required by this method, increases the size of the apparatus, requires high 
assembly accuracy and consequently increases the manufacturing cost. 

[0022] Fig. 18 is a view schematically showing the device stmcture of a two-output-type CCD image sensing device 
obtained by splitting a horizontal transfer CCD. 

[0023] In this image sensing device shown in Fig. 18, electric charge generated pixel-by-pixel in a photodiode unit 
^0 59 is transferred to a vertical transfer CCD (VCCD) 60 at once at a predetermined timing . At the next timing, this electric 
charge in the VCCD 60 is transfen^ed line-by-line to left and right horizontal transfer CCDs (HCCDs) 57 and 58. The 
HCCD 57 transfers this electric charge to a left amplifier 55 for each. transfer clock, and the HCCD 58 transfers the 
electric charge to a right amplifier 56 for each transfer clock, in this Jmage sensing device, therefore, a sensed image 
signal is read out as it is divided into two, left and right regions on the two sides of the center of the frame. Although 
^5 not shown, optical black (OB) units shielded from light by, e.g., aluminum are present on the left and right ends of an 
effective pixel area which, among other pixels, generates electric charge when exposed. 

[0024] Fig. 19 is a block diagram of a signal processing circuit for processing an output signal from an image sensing 
device of the type shown in Fig. 18. Left and right image signals sensed by a CCD 11 are subjected to CDS/AGC 
processing by two CDS/AGC circuits 14 and 15 and converted into digital signals by two A/D conversion circuits 16 

50 and 17, respectively These digital signals are stored in frame memories 20 and 23. 

[0025] Since the image sensing device 11 and the CDS/AGC circuits 14 and 15 are AC-coupled, DC components 
are removed when image signals are input from the image sensing device 11 to the CDS/AGC circuits 14 and 1 5. To 
regenerate these DC components, clamping circuits 18 and 19 clamp the image signals sensed in the left and right 
regions of the image sensing device 11 in accordance vyith the pixel values of Optical Black (OB) pixel portions in these 

55 regions. That is, the levels of the whole image signals sensed In the left and right regions of the image sensing device 
11 are adjusted such that the pixel values of these OB pixel portions have a predetermined level. 
[0026] As described above, the OB pixel portions of the jmage siensing device 11 are positioned on the left and right 
ends of the effective pixel area. The pixel values of these OB pixel portions are slightly different owing to shading of a 
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dark current and the like. Accordingly, when the franie is divided into two, left and right regions and DC levels are 
regenerated by separately clamping image signals in these left and right regions on the basis of the pixel values of the 
OB pixel portions, an offset difference is produced between the left and right regions of the frame. Consequently, an 
image having different DC levels con-esponding to the level difference between the pixel values of the two OB pixel 
portions is obtained. 

[0027] The left and right image signals thus processed separately are synthesized by an image synthesizing circuit 
24. A color processor 25 performs color processing such as color Interpolation and gamma conversion for the synthetic 
image signal, thereby fomiing an image signal of one image. 

[0028] This technology of equipping an image sensing device with a plurality of output terminals and simultaneously 
reading out image signals from these output terminals is an essential technology of allowing future digital cameras to 
approach or exceed the performance of silver halide cameras (a single-lens reflex camera capable of photographing 
about 8 frames/sec is already realized as a product). 

[0029] This technology of equipping an image sensing device with a plurality of output terminals is advantageous in 
speed. However, the technology is obviously more disadvantageous than a single-output image sensing device from 
a viewpoint of output level matching. 

[0030] That is, to regenerate a DC component removed when an image signal is supplied to the CDS/AGC circuit, 
the CDS/AGC circuit or the camera DSP conventionally perfomis a clamping process in each region of an image 
sensing device on the basis of the optical black (OB) level. In this method, however, if there is a difference between 
the OB level for determining the clamp level and the black level of an effective pixel area, or if OB levels output from 
a plurality of output tenninals of the image sensing device are different owing to daric current shading, offset differences 
between the outputs from the plurality of regions of the image sensing device cannot be completely removed. Conse- 
quently, boundaries between the plurality of regions appear in the synthetic image. 

[0031] Accordingly, it is an important subject to remove offset differences between output image signals from a plu- 
rality of output tenninals of an image sensing device. 

[0032] This will be explained in more detail with reference to Figs. 20A and 20B. 
[0033] Fig. 20A shows the arrangement of another conventional image sensing device. 

[0034] That is. Fig. 20A is a view showing an arrangement for dividing a photoelectric conversion output from a light 
receiving unit 1 to two, left and right horizontal transfer CCDs (HCCDs) 4L and 4R and simultaneously reading out 
these outputs. In this image sensing device having the configuration shown in Fig. 20A, photoelectric conversion outputs 
are transfen-ed in the form of electric charge by the HCCDs 4L and 4R for each horizontal line. More specifically the 
left-half and right-half photoelectric conversion outputs are transferred in the form of electric charge to the left and right 
by the HCCDs 4L and 4R, respectively, and subjected to charge-voltage conversion by discretely prepared charge- 
voltage conversion amplifiers 5L and SR. 

[0035] In this configuration, read operations can be performed parallel by the two HCCDs 4L and 4R. So, one frame 
can be read out in a driving time half that of the configuration shown in Fig. 1 6. 

[0036] Additionally, in the arrangement shown in Fig. 20A, the image sensing unit is realized by one CCD. Since 
means such as an optical path divider is unnecessary, it is possible to simplify the an-angement of the image sensing 
system and reduce the cost of the system. However, the left and right regions of a sensed image are separately read 
out by the independent systems (i.e., the HCCD 4L and the amplifier 5L, and the HCCD 4R and the amplifier 5R). So, 
a difference in the boundary is conspicuous. 

[0037] Fig. 20B shows examples of photoelectric conversion outputs of one horizontal line indicated bv a - a' in Flo 
20A. 

[0038] Fig. 20A shows an example of a landscape on a clear day in which the sun, mountains, trees, and grass are 
shown. Refemng to Fig. 20B. a level A indicates an output from an OB portion 2R in Fig. 20A, a level B indicates an 
output from an OB portion 2L. and a level C Indicates an output from a portion con-esponding to the sun. A difference 
D is a level difference produced when the image is read out by the left and right independent systems described above. 
[0039] A method of making this level difference be naturally seen in the frame is called frame matching. One example 
Is a method of making a density difference in a boundary inconspicuous. This method is to con-ect the density difference 
in the boundary on the basis of the degree of con-elation obtained from image data in the boundary. Improving the 
accuracy of this method requires a countermeasure against a dark current which lowers the S/N. 

SUMMARY OF THE INVENTION 

[0040] The present invention has been made in consideration of the above situation, and has as its object to provide 
a technology for reducing offset differences between a plurality of image signals output from a plurality of output ter- 
minals fomied in one-to-one correspondence with a plurality of regions of an image sensing device, thereby obtaining 
a good image having natural boundaries between the regions. 

[00411 It Is another object of the present invenfion to cope with an increase of the number of pixels of an image 
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sensing device. 

[0042] According to the present invention, the foregoing object is attained by providing a signal processing apparatus 
for processing an innage signal, comprising: an image sensing unlt.which comprises a plurality of image sensing regions 
constructing one frame and a plurality of output terminals in one-to-one correspondence with the plurality of image 

5 sensing regions, and which outputs, from each of the plurality of output terminals, an image signal pertaining to image 
sensing in a con-esponding image sensing region and a dummy image signal conceming the conresponding image 
sensing region; and a processor adapted to reduce offset differences between a plurality of image signals output from 
the plurality of output terminals, on the basis of a plurality of dummy image signals output from the plurality of output 
terminals, wherein the plurality of dummy image signals are independent of electric charge obtained from photoelectric 

10 converters of the image sensing unit. 

[0043] According to the present invention, the foregoing object is also attained by providing a signal processing 
apparatus for processing an image signal, comprising a plurality of vertical transfer units for transferring signals from 
a plurality of photoelectric converters of a plurality of image sensing regions in which the plurality of photoelectric 
converters are arranged in horizontal and vertical directions and which collectively construct one frame, a plurality of 

15 horizontal transfer units formed in one-to-one correspondence with the plurality of image sensing regions and each 
comprising a plurality of transfer stages, a plurality of output terminals fomried in one-to-one correspondence with the 
plurality of horizontal transfer units, and a processor adapted to reduce offset differences between a plurality of image 
signals output from the plurality of output temiinals, on the basis of dummy image signals output from the plurality of 
output terminals, wherein the dummy output signal is obtained by performing idle transfer in the plurality of horizontal 

20 transfer units. 

[0044] In a preferred embodiment, the processor corrects the gains of the plurality of image signals whose offset 
differences are reduced on the basis of the plurality of dummy image signals. 

[0045] According to the present Invention, the foregoing object is also attained by providing a signal processing 
method of processing an image signal, comprising reducing offset diffjerences between a plurality of image signals 

25 output from a plurality of output terminals of an Image sensing unit which comprises a plurality of Image sensing regions 
constructing one frame and the plurality of output terminals in one-to-one correspondence with the plurality of image 
sensing regions, and which outputs, from each of the plurality of output terminals, an image signal pertaining to image 
sensing in a corresponding image sensing region- and a .dummy image signal conceming the con'esponding image 
sensing region, on the basis of a plurality of dummy image, signals .output from the plurality of output terminals, wherein 

30 the plurality of dummy image signals are Independent of electric charge obtained from photoelectric converters of the 
image sensing unit. 

[0046] According to the present invention, the foregoing object is also attained by providing a signal processing 
method in a signal processing apparatus comprising a plurality of Image sensing regions which comprise a plurality of 
photoelectric converters an-anged in horizontal and vertical directions and which construct one frame, a plurality of 

35 vertical transfer units for transferring signals from the plurality of photoelectric converters, a plurality of horizontal trans- 
fer units formed In one-to-one con^espondence with the plurality of image sensing regions and each comprising a 
plurality of transfer stages, and a plurality of output temiinals fomied in one-to-one correspondence with the plurality 
of horizontal transfer units, the method comprising reducing offset differences between a plurality of image signals 
output from the plurality of output terminals on the basis of a dummy image signal obtained by performing idle transfer 

40 in the plurality of horizontal transfer units and output from the plurality of output terminals. 

[0047] Other features and advantages of the present Invention will be apparent from the following description taken 
in conjunction with the accompanying drawings. In which like reference characters designate the same or similar parts 
throughout the figures thereof. 

45 BRIEF DESCRIPTION OF THE DRAWINGS 

r 

[0048] The accompanying drawings, which are Incorporated in and constitute a part of the specification. Illustrate 
embodiments of the invention and, together with the diescription, serve, to explain the principles of the invention. 

50 Fig. 1 is a block diagram schematically showing a hardware configuration of an image sensing apparatus Including 

a signal processing circuit according to a first embodiment of the present invention; 

Fig. 2 is a view showing a practical example of ap output signal frpm an image sensing device according to the 

first embodiment of the present invention; 

Fig. 3 Is a view showing a practical example of an output signal from an Image sensing device according to a 
55 second embodiment of the present invention; 

Fig. 4 is a schematic block diagram showing the arrangement of an image sensing apparatus according to a third 
embodiment of the present invention; 

Fig. 5 is a view showing the concept of output data from an Image processor according to the third embodiment 
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of the present invention; 

Fig. 6 is a view showing the arrangement of an image sensing unit shown in Fig. 4; 

Fig. 7 is a view showing an image seen in the finder of the image sensing apparatus according to the third em- 
bodiment of the present invention; 
5 Fig. 8 is a view for explaining a light receiving unit of an innage sensing device included in the image sensing unit 

shown in Fig. 4; 

Figs. 9A, 9B, and 9C are views for explaining a con-ection process according to the third embodiment of the present 

invention; 

Fig. 1 0 is a flow chart showing the procedure of an original Image processor according to the third embodiment of 
10 the present invention; 

Fig. 11 is a schematic block diagram showing the arrangement of an image sensing apparatus according to a 
fourth embodiment of the present invention; 

Fig. 12 is a flow chart showing the procedure of an original image processor according to the fourth embodiment 
of the present invention; 

15 Fig. 13 is a schematic block diagram showing the arrangement of an image sensing apparatus according to a fifth 

embodiment of the present invention; 

Fig. 14 is a flow chart showing the procedure of an original image processor according to the fifth embodiment of 
the present invention; 

Fig. 1 5 is a flow chart showing the operation of determining whether to execute dark current correction according 
20 to the fifth embodiment of the present invention; 

Fig. 16 is a view showing the arrangement of a conventional image sensing device; 
Fig. 1 7 is a view showing the arrangement of a general digital camera; 

Fig. 18 is a view showing an example of an image sensing device which outputs image signals of a plurality of 
regions in parallel by dividing one frame into these regions; 
25 Fig. 1 9 is a block diagram of a conventional signal processing circuit for processing output signals from an image 

sensing device of the type shown in Fig. 18; and 

Figs. 20A and 20B are views showing the arrangement of another conventional image sensing device. 
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

30 

[0049] Preferred embodiments of the present invention will now be described in detail in accordance with the ac- 
companying drawings. 

<First Embodiment> 

35 

[0050] Fig. 1 is a block diagram schematically showing the hardware configuration of an image sensing apparatus 
(e.g., a digital camera) including a signal processing circuit according to a prefen-ed embodiment of the present inven- 
tion. In this embodiment, as an Image sensing device for outputting image signals of a plurality of regions in parallel 
by dividing one frame into these regions, a CCD 29 which outputs image signals of two regions in parallel by dividing 
40 one frame into these two regions is used. This CCD 29 has two outputs (output tenmlnals, output signals) CHI and 
CH2 con-esponding to the two regions. More specifically, the CCD 29 is driven by a driver 30 to operate at a predeter- 
mined frequency, and outputs left and right image signals separately by vertically dividing the whole frame as shown 
in Fig. 18. 

[0051] An optical image of an object is formed on the image sensing surface of the CCD 29 by a main optical system 
45 (not shown). This optical image is photoelectrically converted by a plurality of photodiodes (photoelectric converters) 
59 two-dimensionatly an-anged on the image sensing surface. The photoelectrically converted image is longitudinally 
(vertically) transferred to two, left and right horizontal transfer CCDs (HCCDs) 57 and 58 via vertical transfer CCDs 
(VCCD) 60. The image is further transfen-ed laterally (horizontally) (to the left and to the right) by the HCCDs 57 and 
58 and output via output amplifiers 55 and 56. 
50 [0052] In the CCD 29 having the configuration shown in Fig. 1 8, the HCCDs 57 and 58 have extra stages in addition 
to stages equal in number to pixels in the lateral direction of the VCCDs 60 (or the photodiode unit 59) . More specifically 
the CCD 29 of this embodiment has extra stages 57d and 58d between HCCDs 57V and 58V to which electric charge 
(image signal) is directly transferred from the VCCDs 60, and the output amplifiers 55 and 56, respectively The HCCDs 
58 and 59 transfer dummy signals by the same number as the number of the HCCDs 57d and 58d. That is, in this CCD 
55 29, the HCCDs 57 and 58 are driven after electric charge is transferred to these HCCDs 57 and 58. thereby outputting 
dummy pixel levels (levels of charge (signals) remaining in the HCCDs 57 and 58 before the transfer of electric charge 
from the VCCDs 60 is started) independent of the output from the photodiode 59, by the same number as the number 
of stages of the extra HCCDs 57d and 58d. 
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[0053] Referring back to Fig. 1 , a TG/SSG circuit 31 is a timing generator for outputting a vertical sync signal VD 
and a horizontal sync signal HD. These vertical and horizontal sync signals VD and HD are supplied to the driver 30, 
CDS/AGC circuits 32 and 33, and A/D conversion circuits 34 and 35. 

[0054] As shown in Fig. 2, output image signals corresponding to the right-half and the left-half of the frame of the 
5 CCD 29 contain outputs of effective pixel portions (left and right effective pixel portions), outputs of OB pixel portions 
(left and right OB pixel portions), and outputs of dummy pixel portions (left and right dummy pixel portions), as outputs 
of one lateral line. The left and right dummy pixel portions correspond to the extra HCCDs 57d and 58d described 
above. The amplifier 55 of the CCD 29 outputs signals.of the left dummy pixel portion, left OB pixel portion, and left 
effective pixel portion in this order. The amplifier 56 outputs signals of the right dummy pixel portion, right OB pixel 
10 portion, and right effective pixel portion in this order. 

[0055] The image output from the right-half frame of the CCD 29 is supplied to the CDS/AGC circuit 33 from the 
terminal CH1. Since this temiinal CH1 is AC-coupled to^the CDS/AGC circuit 33, a DC component of the signal is 
removed. In the CDS/AGC circuit 33, a CDS circuit perfonns correlated double sampling and the like on the supplied 
signal of the right-half firame to thereby remove reset noise and the tike contained In the output signal fr'om the CCD 
15 29. Also, an AGC circuit amplifies the output signal to a predetermined signal level. The signal amplified by this AGC 
circuit is supplied to the A/D conversion circuit 35 where the signal is converted into a digital signal to obtain a signal 
AD-CH1. 

[0056] Similariy, the image output from the left-half franne of the CCD 29 is supplied from the terminal CH2 to the 
CDS/AGC circuit 32, and a DC component of the signal is removed. In this CDS/AGC circuit 32, a CDS circuit performs 
20 correlated double sampling and the like on the supplied signal of the left-half frame to thereby remove reset noise and 
the like contained in the output signal from the CCD 29. Also, an AGC circuit amplifies the output signal to a predeter- 
mined signal level. The signal amplified by this AGC circuit is supplied to the AID conversion circuit 34 where the signal 
is converted into a digital signal to obtain a signal AD-CH2. 

[0057] The signal AD-CH 1 is then supplied to a dummy clamping circuit 37. The dummy clamping circuit 37 calculates 
25 the average value of the signal values of a predetermined number of pixels of the right dummy pixel portion sequentially 
output line-by-line, and subtracts the average value from each pixel value of an image signal of one line subsequently 
output from the right-half frame. That is, the dummy clamping circuit 37 perfonns a clamping process for shifting the 
level of the whole one line, so as to correct the signal, level (dunfimy pixel level) of the right dummy pixel portion to a 
. predetermined value (in this case, zero). The clamping process need not be perfonned by subtracting, from each pixel 
30 value of an image signal of each line, the average value of the signal values corresponding to that line of the right 
dummy pixel portion. For example, it is possible to sukitract the average value of the signal values corresponding to a 
plurality of lines of the right dummy pixel portion,' or. subtract the intermediate value (median) of the signal values 
corresponding to one or a plurality of lines of the right dummy pixel portion.. Some other method can also be used. 
[0058] Alternatively, the CDS/AGC circuit 33 or the AD ponversipn circuit 35 can incorporate a clamping circuit and 
35 perform clamping on the basis of the dummy pixel portion by using the built-in clamping circuit alone. 

[0059] By performing the clamping process for all lines, it is possible to cancel longitudinal (vertical) shading gener- 
ated in analog circuits, and correct the level of an image signal of the right-half frame so as to hold the dummy pixel 
level constant on all lines. 

[0060] Likewise, the signal AD-CH2 is supplied to a dummy clamping circuit 36. The dummy clamping circuit 36 
40 calculates the average value of the signal values of a predetermined number of pixels of the left dummy pixel portion 
sequentially output line-by-line, and subtracts the average value from each pixel value of an image signal of one line 
subsequently output from the left-half frame. That is, the dummy clamping circuit 36 performs a clamping process for 
shifting the level of the whole line, so as to correct the signal level (dummy pixel level) of the left dummy pixel portion 
to the same level as the dummy pixel level of the right-half frame. .The clamping process need not be performed by 
45 subtracting, firom each pixel value of an image signal of each line, the average value of the signal values con-esponding 
to that line of the left dummy pixel portion. For example, it is possible to subtract the average value of the signal values 
corresponding to a plurality of lines of the right dummy pixel portion, or^ subtract the intermediate value (median) of the 
signal values corresponding to one or a plurality of lines of the right dummy pixel portion. Some other method can also 
be used. 

50 [0061] Alternatively, the CDS/AGC circuit 32 or the AD conversion circuit 34 can incorporate a clamping circuit and 
perform clamping on the basis of the dummy pixel portion by using the built-in clamping circuit alone. 
[0062] By perfonning the clamping process for alt lines, it is possible to cancel longitudinal (vertical) shading gener- 
ated in analog circuits, and con-ect the level of an image signal of the left-half frame so as to hold the dummy pixel 
level constant on all lines. 

55 [0063] In this embodiment as described above, the clamping process is separately perfonmed for the left and right 
regions not on the basis of the pixel values in the OB pixel portions, but on the basis of the pixel values in the left and 
right dummy pixel portions. For example, even if dari< cun'ents in the OB pixel portions in the left and right regions are 
different, an offset difference between image signals in the left and right regions can be removed regardless of the 



7 



EP 1246 453 A2 

dark current difference. 

[00641 The image signals thus processed by the dummy clamping circuits 36 and 37 are supplied to gain adjusting 
circuits 38 and 39. To correct a gain difference between the image signals, of the left and right regions, generated by 
the amplifiers of the CCD 29, the CDS/AGC circuits 32 and 33. and the AD conversion circuits 34 and 35 these gain 
adjusting circuits 38 and 39 multiply the output image signals from the dummy clamping circuits 36 and 37 by a gain 
correction value provided by the overall processing CPU 48. thereby removing the gain difference between the image 
signals of the left and right regions. 

[0065] Methods of obtaining a gain con-ection value will be explained below. 

[0066] In the first method, a gain value is obtained in advance of shipment from the factory, and the gain adjusting 
circuits 38 and 39 perform gain correction by using this value (fixed value). 
[0067] The second method is as follows. 

[0068] First, before main Image sensing is performed (before the user photographs an object image which he or she 
wants), calibration image sensing is performed to obtain a calibration image. 

[0069] This calibration image may be obtained by, e.g.. sensing a white image by the user. Altematively a light source 
such as an LED is provided in the shutter, and this LED is tumed on with the shutter closed and sense an image before 
mam image sensing is perfonned, thereby obtaining a calibration Image. 

[0070] After that, this calibration Image is clamped by the dummy clamping circuits 36 and 37 In the same manner 
as described above. 

[0071] An overall control CPU 48 compares calibration images (output from different output terminals) clamped by 
the dummy clamping circuits 36 and 37. In accordance with the comparison result, a gain correction value is calculated 
[0072] The third method will be explained last. 

[0073] In the above second method, a gain correction value is obtained by comparing the two calibration images In 
this third method, however, no calibration image sensing is perfomied. and the overall control CPU 48 compares images 
(output from different output terminals) obtained by main image sensing. In accordance with the comparison result a 
gain correction value is calculated. 

[0074] In the second and third methods, a gain correction value Is calculated whenever Image sensing Is performed 
Accordingly, images having higher quality can be obtained. 

[0075] By perfomiing the dummy clamping process and the gain correction process as described above, the offset 
difference and the gain difference between the image signals of the left and right regions of the CCD 29 are removed. 
Therefore, when these signals are synthesized by an image synthesizing circuit 46, the boundary between the two 
regions is inconspicuous. However, If these signals are directly output, the black level has not been adjusted to a 
predetemiined value, so black becomes too bright or too dark in the output Image. 

[0076] To prevent this, the two gain-corrected signals are supplied to OB clamping circuits 40 and 41 and clamped 
on the basis of the pixel values in the OB pixel portions. As shown in Fig. 2, these OB pixel portions are formed in the 
left and nght regions. However, If the OB clamping process Is separately performed for the left and right image signals 
on the basis of the pixel values in the left and right OB pixel portions, the offset difference once removed appears 
between the two regions. 

[0077] To solve this problem, in the first embodiment a DC component is regenerated by clamping the left and right 
image signals by a common value on the basis of the pixel values in one of the left and right OB pixel portions For 
example, the average value of the pixel values of a predetermined number of pixels, contained in the output signal 
from the left-half frame, of the OB pixel portion is calculated. The OB clamping circuit 40 subtracts this average value 
from each pixel value of an image signal of one line in the left-half frame. At the same time, this average value is 
supplied to the OB clamping circuit 41 and subtracted from each pixel value of an image signal of one line In the right- 
half frame. This processing Is executed for all lines. 

[0078] Note that the present invention is not limited to the pixel value In one of the left and right OB pixel portions 
As an example, the average of both the left and right pixel values can also be used. 

[0079] Subsequently, these image signals are written in frame memories 42 and 45 via memory controllers 43 and 
44. After that, the image synthesizing circuit 46 synthesizes the two image signals to generate an Image signal of one 
frame image. A color processing circuit 47 in the next stage perfonns predetermined color processing (e.g.. color 
interpolation and gamma conversion) on the generated image signal. 

<Second Embodiment> 

[0080] The second embodiment of the present invention will be described below. When an Image sensing device 29 
having a plurality of output terminals is a CCD as shown In Fig. 18 and HCCDs 57 and 58 keep transferring signals 
exceeding the number of stages of these HCCDs 57 and 58. as shown In Fig. 3. after charge signals of left and right 
dummy pixel portions, left and right OB pixel portions, and left and right effective pixel portions are output in this order 
charge signals of left and right dummy pixel portions containing signal components of only the HCCDs 57 and 58 (1 
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e., not containing electric charge transferred from a VCCDs 60) are output. The left and right dummy pixel portions 
from which charge signals are output later will be called rear left and right dummy pixel portions. Further, the left and 
right dummy pixel portions output first will be called front left and right dummy pixel portions. 
[0081] The charge signals output from the front left and right dummy pixel portions and the charge signals output 

5 from the rear left and right dummy pixel portions contain components of only the HCCDs 57 and 58 independent of 
charge generated by photodiodes 59, so these signals are supposed to have the same level. However, if signals are 
varied in an analog manner by disturbance or the like in amplifiers 55 and 56, CDS/AGC circuits 53 and 54, and A/D 
conversion circuits 55 and 56 of the CCD 29, the above-mentioned signals do not have the same level. In this case, 
since signals of the rear left and right dummy pixel portions are output Immediately after signals of the boundary portion 

10 between the left and right regions of the effective pixel portion is output, so their output timings are close to the output 
timing of the boundary portion between the left and right regions of the effective pixel portion. Accordingly, these rear 
left and right dummy pixel portions are less influenced by level fluctuations of signals in analog circuits than the front 
dummy pixel portions. This allows the signals of the rear left and right dummy pixel portions to have high con-elation 
with the signals of the effective pixel portions, particulariy. the signals of the boundary portion between the left and 

15 right regions of the effective pixel portion. 

[0082] As in the first embodiment, therefore, output signals from the left and right regions of the CCD 29 are separately 
input to CDS/AGC circuits 33 and 32 and AID conversion circuits 35 and 34 to obtain digital signals AD-CH1 and 
AD-CH2, respectively. After that, dummy clamping circuits 37 and 36 shown in Fig. 1 perform clamping on the basis 
of the signal values of the rear dummy pixel portions. This processing is also the same as in the first embodiment. That 

20 is, the average values of the signal values of a predetermined number of pixels of the rear left and right dummy pixel 
portions sequentially output line-by-line are calculated. The average values are subtracted from pixel values of image 
signals of one line subsequently output from the left-half and right-half frames. The level of the whole one line is shifted 
so as to set the signal levels of the rear left and right dummy pixel portions to a predetennined value. The clamping 
process need not be performed by subtracting, from each pixel value of an image signal of each line, the average 

25 values of the signal values corresponding to that line of the left and right dummy pixel portions. For example, it Is 
possible to subtract the average values of the signal values corresponding to a plurality of lines of the left and right 
dummy pixel portions, or subtract the intermediate values (medians) .of the signal values corresponding to one or a 
plurality of lines of the left and right dummy pixel portions. Some othei" method can also be used. 
[0083] Alternatively, the CDS/AGC circuits 32 and 33 or the AD conversion circuits 34 and 35 can incorporate a 

30 clamping circuit and perform clamping on the basis of the left and right dummy pixel portions by using the built-in 
clamping circuit alone. 

[0084] By performing this clamping process for all lines, it is possible to cancel longitudinal (vertical) shading gen- 
erated in analog circuits, and correct the image levels of the leftrhalf and right-half frames so as to hold the dummy 
pixel level constant. 

35 [0085] In addition, as in the first embodiment, gain adjusting circui.ts 38 and 39 correct a gain difference between the 
left and right outputs. After that, OB clamping circuits 40 and 41 clamp these signals by the same OB value to reproduce 
a DC component. An image synthesizing circuit 46 synthesizes the left and right image signals to generate an image 
signal of one image, and color processing is performed. 

[0086] As described above, the clamping process is executed *on the basis of the signal values of the rear dummy 
40 pixel portions. Consequently, even if signals fluctuate in an analog manner in the CCD amplifiers. CDS/AGC circuits, 
and A/D conversion circuits, an offset difference between the image signals in the left and right regions can be well 
removed. In this embodiment, items other than those described above are the same as in the first embodiment. 

<Third Embodiment> 

45 

[0087] Fig. 4 is a schematic block diagram showing the arrangement of an image sensing apparatus such as a digital 
camera according to the third embodiment of the present invention. 

[0088] As shown in Fig. 4, the image sensing apparatus includes an image sensing unit 101 such as a CCD area 
sensor, a microcomputer (PRS) 105 for controlling the overall image processing, an original image processor 110 for 

50 processing an image signal from the image sensing unit 101 . an image processor 104 for receiving the output from 
the original image processor 110 and performing processing such as white balance correction and color interpolation, 
and a storage unit 103 having a nonvolatile storage device for saving innage data of a plurality of images. The image 
sensing apparatus further includes a display processor 120 for displaying processed image data, a display memory 
1 2 1 , a display unit 1 22 such as an LCD, and a JPEG compressor 1 25 arid storage device 1 30 for storing processed data. 

55 [0089] The microcomputer 1 05 is a one-chip computer in which a CPU (Central Processing Unit), RAM, ROM, EEP- 
ROM (Electrically Erasable Programmable ROM), input/output ports, and the like are arranged. 
[0090] This microcomputer 105 performs a seri^ of operation's on the basis of a sequence program stored in the 
ROM. The characteristic feature of the present invention is the original image processor 11 0. Therefore, an arrow is 
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added in Fig. 4 to clearly indicate that this original image processor 110 is under the control of the microcomputer 105. 
However, the remaining portions are also controlled by the microcomputer 105. 

[0091] In the image sensing unit 101 , an image of a bundle of rays from an object is formed on an image sensing 
device via an optical system (not shown). The image sensing device photoelectrically converts the object image into 

5 an electrical signal. The electrical signal is further converted into a digital signal and output to the original image proc- 
essor 110. Details of this image sensing unit 101 will be described later with reference to Fig. 6. 
[0092] The original image processor 110 receives the sensed image signal output from the image sensing unit 101. 
As a preparation for dark correction by an OB clamping unit 111 , the original image processor 110 extracts pixel data 
of a light-shielded portion (optical black) and temporarily stores the data in a buffer memory of the storage unit 103. 

10 This buffer memory has a capacity capable of storing sensed image data, read out from the image sensing device, of 
a plurality of frame images with Image data of a frame image as a unit. 

[0093] When an image sensing operation is pertormed a plurality of number of times within a short time period, i.e., 
when continuous image sensing is to be performed, the buffer memory functions to eliminate or minimize the influence 
of the processing speed of the image processor 104 and its subsequent units. In the third embodiment, the buffer 
15 memory is also imparted a function of storing an image sensing device dark output used to correct the daric cun-ent of 
pixel data. 

[0094] A memory controller 1 1 3 controls data inputting and outputting between the original image processor 1 1 0 and 
the storage unit 103. 

[0095] Pixel data once stored in the storage unit 103 is loaded into the original image processor 110 and subjected 
20 to signal processing by a dark current con-ector 114, a frame correlation extractor 112, an image matching unit 116, a 
shading corrector 117, a flaw corrector 118, and the like. A switch 141 selectively supplies data in accordance with 
whether to perform frame con-elation extraction or signal processing for outputting the data to the image processor 104. 
[0096] The signal processing procedure in the original image processor 110 will be described in detail later with 
respect to Fig. 10. 

25 [0097] For the pixel data processed by the original image processor 1 1 0, the image processor 1 04 performs a series 
of image processing for so-called picture formation, e.g., white balance correction, gamma correction, color interpola- 
tion, and color correction, and outputs R, G, B component signals. Therefore, to perform color interpolation, the output 
data amount from the image processor 104 Is Increased to be an integral multiple of the output data amount from the 
original image processor 110. 

30 [0098] For example, when the image sensing device of the image sensing unit 1 01 is covered with color filters of the 
Bayer anangement, lines for altemately outputting R (Red) and G (Green) signals and lines for altemately outputting 
G and B (Blue) signals are arranged on every other horizontal line. The output data from the original image processor 
1 1 0 also has the order of the Bayer an-angement. Accordingly, when the image processor 1 04 perfomns color interpo- 
lation for input data and outputs R. G, and B data for each pixel, the image data amount is three times that of the input 

35 data. This is conceptually shown in Fig. 5. 

[0099] The output from the image processor 1 04 is subjected to signal processing, including filter processing, per- 
formed by the display processor 1 20 to reduce the image size, so that the size becomes an optimum size to be displayed 
on a display unit 122 such as an LCD of the image sensing apparatus. After that, the processed data is stored in the 
display memory 121 . That is, the data is stored for each color component R, G, or B, and interfacing with a driver of 

40 the LCD display unit 122 of the camera is also done by R, G, and B. Outputting is perfonned line-by-line similar to 
inputting. 

[0100] The JPEG compressor 125 comprises a YUV converter and a JPEG encoder. The YUV converter converts 
the input R, G, and B image data from the image processor 104 into luminance and color difference components, and 
the JPEB encoder perfonns image compression. That is, the JPEG encoder compresses the input image data by JPEG 
45 encoding. In this embodiment, Discrete Cosine Transfomi (DCT) and Huffman transform are performed. The JPEG 
encoder also has a function of converting the luminance signal and color difference signals from raster scan to zigzag 
scan, in order to perform DCT, by using a minimum unit of 8 (longitudinal) x 16 (lateral) pixels for the luminance signal 
and a minimum unit of 8 x 8 pixels for the color difference signals. 

[0101] The compressed data is sequentially stored in the subsequent storage device 130. The above encoding proc- 
50 ess is repeated for one frame of the sensed image data from the image sensing unit 101. Before or after this JPEG 

encoding, the microcomputer 105 generates, where necessary, a header or footer such as image sensing date/time 
information in an arbitrary form, and stores this header or footer together with the image data compressed by encoding 
into the storage device 130. 

[0102] More specifically, image data having two different image sizes are stored in the storage device 130 on the 
55 basis of the same sensed image data. The first image data is not subjected to image reduction by an intemal image 
reducing unit of the image processor 104. The second image data is subjected to this image reduction by the internal 
image reducing unit of the image processor 1 04. The first image data is generated as image data indicating the sensed 
image. The second image data is generated to be handled as management information when image data such as 
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thumbnail is to be edited or for confirmation. Although the first and second image data are managed as independent 
files, they are related to each other. 

[0103] Also, values such as the compression ratio necessary for JPEG encoding and transformation reference data 
required for the compression ratio are set by the microcomputer 105 when the shutter of the image sensing apparatus 
5 is pressed. 

[0104] The storage device 130 has a volatile storage device having a relatively high write rate with which a plurality 
of image data can be saved, and a detachable nonvolatile storage device having a relatively low write rate. The output 
from the JPEG compressor 1 25 is first stored in the volatile storage device. That is, two image data representing images 
of different image sizes generated from the same sensed image data are stored. After that, these image data are 
10 sequentially stored in the nonvolatile storage device during intervals b)etween operations of the image sensing appa- 
ratus. 

[0105] The nonvolatile storage device is detachable from the image sensing apparatus. Therefore, the nonvolatile 
storage device may be attached to the image sensing apparatus to write data of one or a plurality of frame images 
from the volatile storage device, thereafter, removed from the image sensing apparatus, then attached to another 
15 system capable of reading data of the data format of the image sensing apparatus. This allows the stored data to be 
reproduced, edited, and saved. In the storage device 130, both the first and second image data described above are 
managed in a format meeting the above purpose. ' - 

[0106] Fig. 6 is a schematic view showing the internal an-angement of the image sensing unit 101 shown in Fig. 4. 
In Fig. 6, reference numeral 90 denotes an image sensing device;such as a CCD area sensor; 81 and 82, well-known 
20 CDS (Correlation Double Sampling)/AGC (Automatic Gain Control) units; and 83 and 84, well-known A/D converters. 
This image sensing unit 101 also includes a sensor driver (not shown) for driving the image sensing device 90. With 
this arrangement, the image sensing unit 101 performs analog processing suited to the readout photoelectric conver- 
sion output, converts the analog signal into a digital signal, and outputs the digital signal. 

[0107] The image sensing device 90 is a known, image sensing device called a Bayer arrangement type CCD. Ref- 

25 erence symbols 91 L and 91 R denote photoelectric conversion elements present in the left- and right-half regions, 
respectively, of the frame; and 92L and 92R, vertical transfer CCDs (VCCDs) present in the left- and right-half regions, 
respectively, of the frame. A photoelectric conversion ielement and a VCCD in each stage make a pair, and an image 
sensing region Is formed by two-dimensionally an'anging a plurality of such pairs. An image is sensed by converting a 
bundle of rays from an object into electi-ic charge by ttie photoelectric conversion elements. Reference symbol 4L 

30 denotes a horizontal CCD (HCCD) for horizontally transfening electric charge sequentially transfen-ed from the VCCDs 
92L; and 4R, an HCCD for horizontally transfening electric charge sequentially transferred from the VCCDs 92R. 
[0108] The light receiving surface of the image sensing device 90 fomiing the Image sensing region is covered with 
primary-color filters of R, G, and B. The G filters are arranged checkerwise, and the R and B filters are arranged every 
otfier line between these G filters (Bayer arrangement). Pixels are arranged in the fomn of a tetragonal lattice. This 

35 facilitates operations after an image is loaded. 

[0109] Electric charges generated in the photoelectric conversion elements 91 L are transferred to the VCCDs 92L, 
and then sequentially transferred vertically toward the HCCD 4L by horizontal lines. After that, the electric charges are 
transferred in a direction B by the HCCD 4L. and converted from the electi'ic charges Into a voltage signal by a charge- 
voltage conversion amplifier 95. The voltage signal is,processed by the CDJS/AGC unit 81 and further converted into 

^0 digital data by the A/D converter 83. After that, the digital data Is output to the original image processor 110 shown in 

Fig- 4. .'-^ i 

[01 10] SImilariy, electric charges generated in the photoelectric conversion elements 91 R are transferred to the VC- 
CDs 92 R, and then sequentially transferred vertically toward the HCCD 4R by horizontal line. After that, the electric 
charges are transferred in a direction A by the HCCD 4R, and converted from the electric charges into a voltage signal 

45 by a charge-voltage conversion amplifier 96. The voltage signal is processed by the CDS/AGC unit 82 and further 
converted into digital data by the A/D converter 84. After tiiat, the.digital data is output to the original image processor 
110 shown in Fig. 4. In this manner, the sensed injage data is separately output in the left and right regions. 
[01 11] The VCCDs 92L and 92R, the HCCDs 4L and 4R, photoelectric conversion elements in a light-receiving unit, 
and photoelecti-ic conversion elements in OB units which are regions shielded from light, all of which construct the 

50 image sensing device 90, are actually larger in number than those shown in Fig. 6. For example, in Fig. 6 one photo- 
electric conversion element at each of the right and left ends in each horizontal line is shown as the OB portion . However, 
a plurality of photoelectric conversion elements are actually arranged at each end to configure the OB portion, 
[01 12] Fig. 7 shows an Image in the finder viewed from a camera eyepiece (not shown). Reference symbols AFP1 
to AFP3 denote three distance measurement points,' representing a. state In which focusing is performed at the distance 

56 measurement point AFP2. Also, indicators in the lower end of Fig. .7 Indicate tiie set states of tiie camera, e.g., the 
shutter speed and the determination of an in-focus state in focusing. For the sake of explanation, all these indicators 
are tumed on in Fig. 7. When the camera is in operation, however, these indicators are independently turned on or off 
in accordance with the operating state, so all the indicators are notiSinniultaneously tumed on as shown in Fig. 7. Also, 
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when any one of the distance measurement points AFP1 to AFP3 is selected for focusing, a region sunounded by the 
outside and Inside rectangles is lighted in red by an optical system and illuminating device (not shown) within a short 
time period during which the user can well confirm which point is selected. 

[01 13] In this state, the light-receiving unit of the image sensing device Included in the Image sensing unit 101 has 
K X L pixels as shown in Fig. 8. This K x L-pixel signal shown in Fig. 8 is processed by the original image processor 
110 and subjected to a series of signal pnxesslng. e.g.. white balance correction, color con-ection. and color interpo- 
lation, performed for each of R. G. and B data by the image processor 104. Consequently, as shown in Fig. 5. output 
images of R, G. and B each having K x L pixels are fomied. That is, the data amount from the image sensing device 
having K x L pixels is tripled after undergone the signal processing by the original image processor 11 0 and the image 
processor 104. 

[01 14] Figs. 9A to 9C are views for explaining con-ection perfomied by calculating an output difference between the 
left and right frames from outputs of a plurality of photoelectric conversion elements near the boundary. 
[0115] Fig. 9A is a simplified view of the image sensing device 90 shown in Fig. 6. This example shown in Fig 9A 
IS a landscape on a clear day in which the sun. mountains, trees, and grass are shown. Note that the same reference 
numerals as in the configuration shown in Fig. 20A described eariier denote the same parts in this configuration shown 
in Fig. 9A, and a detailed description thereof will be omitted. 

[01 16] Fig. 9B shows a photoelectric conversion output of one horizontal line indicated by b - b' in Fig. 9A. A level A 
in Fig. 98 indicates the output level of an OB unit 2R read out from the HCCD 4R. and a level B indicates the output 
level of an OB unit 2L read out from the HCCD 4L in Fig. 9A. A difference D indicates a level difference between the 
right and left frames. 

[0117] Correlation extracting portions A and B shown In Fig. 9A are sensed image data regions used to calculate a 
correction amount for correcting the difference D. The same number (a plurality of) of photoelectric conversion element 
outputs are extracted from the left and right boundaries of the image sensing regions, and a con-elation value is cal- 
culated to generate a correction value. 

[01 18] A method of calculating a correction value in the present invention will be explained below. 
[0119] First, the dark current of pixel data read out from the correlation extracting portion A via the HCCD 4R and 
an amplifier 5R is corrected, and an average value AVGA of the corrected data is calculated. Similariy, the dari^ cun-ent 
of pixel data read out from the con-elation extracting portion B via the HCCD 4L and an amplifier 5L are corrected, and 
an average value AVGB of the con-ected data is calculated. Assuming that the number of pixels In the horizontal 
direction of the con-elation extracting portions A and B Is N. let AS(N) and BS(N) be outputs obtained by correcting the 
dark cun-ents of the pixel data read out from the correlation extracting portions A and B by the HCCD 4R and the 
amplifier 5R, and the HCCD 4L and the amplifier 5L, respectively. That is, the average values AVGA and AVGB are 
calculated by 

AVGA = (AS(1) + AS(2) + - + AS(N))/N 

AVGB = (BS(1) + BS(2) + - + BS(N))/N (1) 
Next, a con-elation value is calculated on the basis of these average values AVGA and AVGB. 



Correlation value = AVGB - AVGA 



(2) 



[0120] The correlation value calculated as above can be directly used as a con-ection value. Therefore, in this em- 
bodiment the pixel data read out via the HCCD 4L and the amplifier 5L and the data subjected to the dark cun-ent 
con-ection are calculated. That is. letting B(n) be the output obtained by correcting the dark current of the pixel data 
read out via the HCCD 4L and the amplifier 5L, 

BB(n) = B(n) + correction value (con-elation value) (3) 

is calculated. Consequently the level corresponding to the difference D can be con-ected. Note that n indicates a pixel 
number and 1 ^ n s k/2 if the number of photoelectric conversion elements fonning one horizontal line is K. Subse- 
quently, an offset value C Is added to the pixel data of the left and right frames. Note that A(n) denotes an output 
obtained by con"ecting the daric current of the pixel data read out via the HCCD 4R and the amplifier 5R. 



12 



EP1246 453 A2 



FB(n)=.BB(n)+.C * (4) 

g FA(n) = A(n) + C (5) 

[0121] Accordingly, a waveform shown in Fig. 9G can be obtained. 

[0122] Note that the offset value C corresponding to the level G in Fig. 9C is an offset value added to both the 
corrected image data, in order to facilitate the'digitafsignal processing in, e.g.. the image processor 1 04 shown in Fig. 4. 

10 [01 23] Note also that the output wavefomns shown in Figs. 98 and 9C indicate output as a display image. However, 
since the output is image data constructed by colorcomponents R, G.jand B obtained from the image sensing device, 
the conrection value described above is independently generated for each of these color components R, G, and B. 
[0124] The processing performed by the original image processor 110 shown in Fig, 4 will be described in detail 
below with reference to Figs. 4 to 10. Fig. 10 Is a flow chart showing the operation of the original image processor 110. 

15 [0125] As shown in Fig. 8, pixel data input from the image sensing unit 101 to the original image processor 110 is 
composed of the outputs from K (horizontal direction) x L (vertical direction) photoelectric conversion elements in the 
light receiving unit, and the outputs from a plurality of photoelectric conversion elements in the OB units 2L and 2R 
shown in Fig. 9A. As shown in Fig, 6, of the outputs from these photoelectric conversion elements, those from the left 
frame and those from the right frame are input parallel to the original image processor 110 via the AID converter 83 

20 and the A/D converter 84, respectively. The original image processor 1 1 0 processes digital pixel data output from these 
two output systems in parallel. 

[0126] First, a process of acquiring dark cun-ent correction data for use in dark current con-ection is performed, 
[0127] The microcomputer 105 controls the image sensing unit 1 01 to reset it such that outputs from photoelectric 
conversion elements have an initial value with no light incident on this image sensing unit 101. After that, the micro- 
25 computer 105 performs a charge accumulation operation for a predetermined time. In step S10, after this charge 
accumulation operation is completed, the microcomputer 1 05 inputs the output digital pixel data from the A/D converters 
83 and 84 in parallel. ' i- 

[0128] In step S11 , the microcomputer 1 05 temporarily stores pixel data con-esponding to dari^ current outputs from 
a plurality of photoelectric conversion elements in the OB units 2L and 2R shown in Fig. 9A, and detemiines digital 

30 data for use in clamping by a known method. Subsequently, the microcomputer 105 clamps pixel data obtained from 
photoelectric conversion elements in the region of theiight-receiving unit 1 shown in Fig. 9A by a known method. 
[01 29] In step SI 2, the microcomputer 1 05 stores the clamped data (dark current correction data) into a dartc current 
correction data storage area secured beforehand in the storage unit 1 03 via the memory control unit 113. Note that in 
order to facilitate handling of the data after that, the memory controller 113 controls this data storage to the storage 

35 unit 1 03 such that the storage sequence of the pixel data transferred in the direction A by the HGCD 4R is opposite to 
the read sequence (i.e., such that the storage sequence is in the direction B). It is also possible to reverse the storage 
sequence of data read out by the HGCD 4L so that the sequence is in the direction A. 

[01 30] The processes from steps SI 0 to SI 2 are repeated L times equal to the number of horizontal lines (i.e., until 
YES in step S13). Gonsequently, load of dark current correction data of one frame is completed. 

40 [0131] Sufc>sequently. the image sensing unit 101 inputs pixel data obtained by normal object image sensing (step 
S14). This pixel data is also clamped (step SI 5). The clamped pixel data is stored in a pixel data storage area secured 
beforehand in the storage unit 103 via the memory controller 113 (step S16). The operations in steps S14 to S16 are 
repeated L times (until YES in step S17, i.e., until processing of image data of one frame is completed). 
[01 32] Next, to perform dartc current con-ection, the switch 141 is switched to input, to the dari^ cun"ent corrector 1 14, 

45 the image data and the dartc current correction data read out from the storage unit 1 03 via the memory controller 113, 
thereby correcting the dari< current of the pixel data (step S18). Under the control of the microcomputer 105, the daric 
current con"ector 114 adjusts the dark current con-ection data by calculations on the basis of accumulation time of the 
pixel data so that the dark current correction data corresponds to the accumulation time when the pixel data is acquired, 
and subtracts the adjusted daric cunrent correction data from the pixel data. This makes it possible to remove dark 

50 current components contained In the pixel data frorn the Individ uar|)hotoelectric conversion elements, and generate 
high<|uatity pixel data having a high S/N ratio. The pixel data subjected to the dark cun-ent correction as above is input 
to the frame correlation extractor 112 and also stored in the storage unit 103. 

[01 33] The frame correlation extractor 1 1 2 performs iframe correlation extraction in order to obtain a correlation value 
as a reference for calculating a correction value required to correct a level difference between the right and left frames 
55 by the image matching unit 1 1 6 (step SI 9). More specifically, when receiving image data from the con-elation extracting 
portions A and B shown in Fig. 9A, the frame correlation extractor 1 1 2 calculates variables AVGA and AVGB by equation 
(1) described above, and also calculates a correlation.value by equation (2) described above. 
[0134] The output correlation value from the frame borfelation extractor 112 is loaded into the microcomputer 105 
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and processed in accordance with processing contents prepared beforehand. After that, the processed value is re- 
flected on difference correction control by the frame matching unit 116. 

[01 35] Subsequently, the frame matching unit 1 1 6 performs frame matching by using the con-ection value generated 
by the microcomputer 105 on the basis of the calculated image correlation value {step S20). Since the switch 141 is 
closed to the frame matching unit 1 1 6, the pixel data undergone the dark current correction is read out from the storage 
unit 1 03 via the memory controller 113. In this third embodiment, frame matching is done by correcting the image data 
of the left frame shown in Fig. 6. 

[0136] In step S20, the image data of the left frame shown in Fig. 6 is input to the frame matching unit 116 via the 
switch 141. The frame matching unit 1 1 6 adds, to the image data of the right frame, a value (offset value) corresponding 
to the level C shown in Fig. 9C as described previously by using equation (5). On the other hand, when the image data 
of the left frame shown in Fig. 6 is input to the frame matching unit 116 via the switch 141, the calculations indicated 
by equations (3) and (4) are performed on the basis of the correlation value of the input line by using the correction 
value prepared beforehand by the nrucnocomputer 105, thereby correcting the level difference. 
[0137] After being subjected to the above matching process by the frame matching unit 116, the image data which 
has been separately output by the two systems of the AID converters 83 and 84 shown in Fig. 6 and independently 
processed are integrated as data of each line. 

[01 38] Subsequently, in step S21 , the shading corrector 117 multiplies the image data subjected to the frame match- 
ing process by a coefficient prepared in advance, thereby correcting distortion produced in the image data by optical 

factors. 

[0139] Next, in step S22, the flaw con-ector 118 replaces portions, where no appropriate photoelectric conversion 

outputs can be obtained owing to dust or flaws, with values calculated on the basis of outputs around these portions. 

The output of a portion having dust or a flaw is different from the outputs of surrounding pixels. Therefore, it is possible 

to determine that there is dust or a flaw if this difference is larger than a predetermined value. 

[0140] The image data completely processed by the flaw corrector 11 8 is sequentially output to the image processor 

104. 

[0141] The frame matching process (step S20), the shading correction process (step S21), and the flaw correction 
process (step S22) are also perfomied for each horizontal line. When these processes are repeated L times (YES in 
step 823), one-frame original image processing for the outputs from photoelectric conversion elements of L horizontal 
lines is completed. 

[0142] By the above processing, the output waveform shown in Fig. 9B Is corrected into the output wavefonn shown 
in Fig. 9C. That is, the difference D shown in Fig. 98 which is the level difference between the right and left frames is 
corrected. Accordingly, image data having no difference between the left and right frames can be obtained. 
[0143] In the third embodiment as described above, when correction is to be perfomned by fi-ame matching, image 
data for which the correction value is to be obtained is subjected to dark current correction in advance. Consequently, 
highly accurate frame matching can be perfomied. 

<Fourth Embodiment> 

[0144] The fourth embodiment of the present invention will be described below with reference to the accompanying 
drawings. 

[0145] Fig. 11 is a schematic block diagram showing the an-angement of an image sensing apparatus such as a 
digital camera according to the fourth embodiment of the present invention. This anrangement shown in Fig. 1 1 differs 
from the arrangement shown in Fig. 4 in that the positions of a switch 141 and a dark current corrector 1 14 are switched. 
Note that the same reference numerals as in Fig. 4 denote the same constituent elements in Fig. 11 , and a detailed 
description of the operations of these elements will be omitted. 

[0146] In the above third embodiment, the original image processor 110 performs dark current correction for one 
frame of image data as preprocessing of frame con-elation extraction, and the image data subjected to this dark cun-ent 
correction is stored in the storage unit 1 03. In the fourth embodiment, an operation in which pixel data requiring process- 
ing is subjected to dahc cun-ent con-ection will be explained. 

[0147] The operation of an original image processor 110' of this fourth embodiment will be described below with 
reference to Fig. 12. 

[0148] Processes performed in steps S10 to S17 are similar to those perfomied in Fig. 10, so a detailed description 
thereof will be omitted. 

[0149] In step S30, clamped image data from correlation extracting portions A and 8 shown in Fig. 9A and dari< 
current correction data are loaded from a storage unit 1 03 via a memory controller 113. In the fourth embodiment, the 
switch 141 does not exist between the dark current con-ector 114 and the memory controller 113. Therefore, data is 
directly input from the nnemory controller 113 to the dark cun-ent con-ector 114. A dark current con-ecting operation in 
this dari< curent con-ector 114 is the same as the operation explained In step S18 of Fig. 10. 



14 



EP1 246 453 A2 



[0150] To obtain a correiation value in step S31, the switch 141 is so closed as to output the image data subjected 
to the dark current correction to a frame correlation extractor 112. Accordingly, the dark current corrector 114 outputs 
the dark-current-corrected image data of the correlation extracting portions A and B to the frame correlation extractor 
112. On the basis of the input data, the frame correlation extractor 112 performs the same operation as in step S19 of 
5 Fig. 10 to obtain a correlation value. The image data subjected to the dark cun-ent correction by the dark cun-ent 
corrector 1 1 4 and input to the frame correlation extractor 112 contains only image data from the region of the correlation 
extracting portions A and B. Therefore, the processes in steps S30 and S31 are completed within time periods much 
shorter than In the third embodiment. 

[01 51] Subsequently, a firame matching unit 116 performs frame matching by using a correction value generated on 
10 the basis of tiie calculated correlation value by a. microcomputer 105.Jn the fourth embodiment, however, the dark 

current corrector 114 performs dark current con-ection before that (step S32). 

[0152] Since the dark current con-ection data and image data of one frame are already stored in the storage unit 
103, these data are read out from the storage unit 1 03 to the dark current corrector 1 14 via the memory controller 113. 
By using the readout data, daric current correction is performed for the image data of one frame in the same manner 

15 asinstepS18of Fig. 10. 

[01 53] Since the switch 141 is so closed as to output data to the frame matching unit 116, the image data subjected 
to tiie dark current con-ection is input to the image matching unit 116. In step S33, frame matching analogous to that 
In step S20 of Fig. 1 0 is perfomned using the correction value generated by the microcomputer 1 05. When tiie matching 
process for tiie image data of one line is completed, the sequence of the image data of the right frame b-ansferred In 

20 a direction A by an HCCD 4R Is reversed (I.e., the data sequence is changed to a direction B). This image data of tiie 
right frame is combined with the image data of the left frame to form image data of one line. This image data of one 
line is output to a shading corrector 1 1 7. Note tfiat it is also possible to reverse the storage sequence of data read out 
by an HCCD 4L so that the sequence is in ttie direction A. 

[01 54] The conversion of ttie sequence of ttie image data of ttie right frame may also be performed by reversing tiie 
25 sequence of read from the storage unit 103 by the memory controller 113 when daric current correction is performed 
in step S32. 

[0155] Shading correction (step S34) and dust-flaw correction (st|p.S35) performed after that are similar to the op- 
erations in steps S21 and S22 of Fig. 10, so an explanation thereof will be omitted. Steps S32 to S35 are repeated L 
times (i.e., the number of horizontal lines) to complete the original image processing of one frame (step S36). 
30 [01 56] In the fourth embodiment as described above, a correction value for frame matching is calculated after only 
a necessary portion is selected from image data of one frame and subjected to dark current correction. Consequently, 
highly accurate frame matching similar to that in the third embodiment can be perfomied with a system configuration 
In which memory control processing Is simple. 

35 <Flflh Embodiment> 

[0157] The fifth embodiment of the present invention will be explained below with reference to the accompanying 
drawings. . ^ 

[0158] In tiie above third and fourth embodiments, image data ^is always subjected to dark current correction as 
^0 preprocessing of frame correlation extraction. In the fifth embodiment, It Is possible to choose whether to perform this 
dark current correction as preprocessing of frame con-elation extraction. 

[01 59] Fig. 13 is a view showing the brief arrangemerit of an image sensing apparatus according to the fifth embod- 
iment. This an-angement is the same as the arrangement shown in Fig. 4 except that a switch 142 is added. Therefore, 
ttie functions of the other constituent elements are. the, same as in Fig. 4, so these elements are denoted by the same 
45 reference numerals as in Fig. 4, and a detailed description thereof will be omitted. 

[01 60] The operation of an original image processor ,1 1 0" will be explained below witti reference to Fig. 14. Note that 
ttie same reference numerals as in Fig. 1 0 denote the same processes, and a detailed description thereof will be 
omitted. 

[01 61] In step S40, whether to perfomi dark current conrection is detemriined. If dari< cun-ent correction is to be per- 
50 formed, a switch 141 is set to "V to output data to a dari( cun-ent corrector 114, and ttie flow advances to step S 18. If 
no daric cun-ent con-ection Is to be performed, the switch 141 is set to "0" and the switch 142 Is set to 'V to output 
Image data directty to a frame con-elation extractor 112 by bypassing the dark cun-ent corrector 114, and the flow 

advances to processing in step S19. 

[0162] An example of tiie operation of detemiining whether to perfpmi dari< current con-ection in step S40 will be 
55 described below with reference to a flow chart In Fig. 15. 

[0163] In step S41. whetiier the operation mode of the camera is continuous shot or single shot photography Is 
detennined. If the camera operation mode Is continuous shot photography mode, it Is detennlned tfiat no daric current 
correction is to be performed (step S44). If the camera operation mode is single shot photography mode, in step S42 
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whether the charge accumulation time in an image sensing unit 101 is equal to or longer than a predetermined time T 
is checked. If the charge accumulation time Is shorter, it is determined that no dark current con-ection is to be performed 
(step S44). If the charge accumulation time is longer, the flow advances to step S43 to measure the present temperature 
of or near the image sensing unit 101 by a thermometer (not shown), and check whether this present temperature is 
equal to or higher than a predetemnined temperature Temp. If the present temperature is higher, it is detemnined that 
dark current correction is to be performed (step S44). If the present temperature is lower, it is determined that no dark 
current correction is to be performed (step S45). 

[01 64] If the charge accumulation time is short or the temperature of the image sensing unit is low and so differences 
between the individual dark cun*ent outputs of a plurality of photoelectric conversion elements are relatively small, the 
influence of negative factors such as the processing time and current consumption increases compared to the con-ecting 
effect of dark cun"ent correction. More specifically, dark current con-ection widens the photographic intervals especially 
when the camera Is operating in the continuous shot photography mode. Therefore, optimum processing can be per- 
lomed by selecting whether to perform dark cun-ent correction for image data to be subjected to frame con-elation 
extraction in accordance with the above factors. 

[0165] Note that the detennj nation conditions are design items, so it will be readily understood that these determi- 
nation conditions can be properly changed on the basis of various conditions. 

[0166] As described above, it is possible to reduce offset differences between a plurality of image signals output 
firom a plurality of output tenminals arranged in one-to-one correspondence with a plurality of regions in an image 
sensing device. As a consequence, a good image having natural boundaries between these regions can be obtained. 
[01 67] It is also possible to increase the number of pixels of an image sensing device. 

<Other Embodiment> 

[0168] In the above third to fifth embodiments, correction is so perfonned as to match the level of the image data of 
the left frame shown in Fig. 6 with that of the image data of the right frame. However, it is also possible to match the 
level of the image data of the right frame with that of the image data of the left frame, or to match the levels of the 
image data of both the left and right frames with ah intermediate level. These operations can be easily performed by 
changing the con"ection value based on the con-elation value obtained by the frame correlation extractor 112. 
[0169] The present invention is not limited to the anangements explained in the above embodiments. For example, 
input signals need not be R, G, and B color components, luminance components, and color difference components. 
Also, an image sensing device need not be a CCD image sensing device. For example, the present invention is similarly 
applicable to an image sensing device such as a CMOS. Furthermore, one photographed image frame can be divided 
into three or more Image blocks. The frame matching method can also be, e.g., statistical processing different fi-om 
the contents explained in the above embodiments, provided that the function of the present invention can be achieved. 
[01 70] The present invention is applicable not only to a digital camera but also to an optical apparatus other than a 
camera or to some other apparatus, as long as the apparatus processes an image signal obtained by image sensing 
by two-dimensionally an*anged photoelectric conversion elements, and finally outputs the signal as an image to an 
output device such as a monitor or printer. 

[0171] Also, the present invention can be applied to various image sensing apparatuses such as a video movie 
camera, video still camera, lens interchangeable camera, single-lens reflex camera, lens shutter camera, and monitor 
camera, and to apparatuses including these image sensing apparatuses. 

[0172] In the above embodiments, image signals obtained by an area sensor are separately read from different 
predetermined regions via a plurality of output systems (e.g., HCCDs and amplifiers). However, the present invention 
is not restricted to this method. For example, it is also possible to photograph a plurality of images by shifting a pho- 
tographic region or using a plurality of area sensors, and synthesize these photographed images to obtain an image 
of a wide object region. That is, the present invention is applicable to various cases in which one Image is acquired by 
synthesizing Image signals output from predetermined regions. 

[01 73] The whole or part of the software in the above embodiments can be replaced with hardware. Likewise, the 
hardware in the above embodiments can be replaced entirely or partly with software. 

[0174] Also, the apparatuses and methods according to the above embodiments can either in whole or in part con- 
stitute the invention. 

[0175] Furthennore, the apparatuses and their components according to the above embodiments can be practiced 
as part of another apparatus or in combination with another apparatus. 

[0176] Further, the object of the present invention can also be achieved by providing a storage medium storing 
program codes for performing the aforesaid pnocesses to a computer system or apparatus (e.g. , a personal computer), 
reading the program codes, by a CPU or MPU of the computer system or apparatus, from the storage medium, then 
executing the program. 

[01 77] In this case, the program codes read from the storage medium realize the functions according to the embod- 
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iments, and the storage medium storing the program codes constitutes the invention. 

[0178] Further, the storage medium, such as a floppy disk, a hard disk, an optical disk, a magneto-optical disk, 
CD-ROM, CD-R, a magnetic tape, a non-volatile type memory card, and ROM, and computer network, such as LAN 
(local area networic) and LAN, can be used for providing the program codes. 
5 [01 79] Furthemiore, besides aforesaid functions according to the above embodiments are realized by executing the 
program codes which are read by a computer, the present invention- includes a case where an OS (operating system) 
or the like working on the computer performs a part or entire processes in accordance with designations of the program 
codes and realizes functions according to the above embodiments. \ 

[01 80] Furthermore, the present invention also includes a case where, after the program codes read from the storage 
10 medium are written in a function expansion card which is inserted into the computer or in a memory provided in a 

function expansion unit which is connected to the computer, CPU or the like contained in the function expansion card 
or unit performs a part or entire process in accordance with designations of the program codes and realizes functions 
of the above embodiments. 

[0181] In a case where the present invention is applied to the aforesaid storage medium, the storage medium stores 
15 program codes corresponding to the flowcharts 7, 9 or 11 , or an operation described in the embodiments. 

[0182] The present invention is not limited to the above embodiments and various changes and modifications can 
be made within the spirit and scope of the present invention. Therefore to apprise the public of the scope of the present 
invention, the following claims are made. 

[01 83] In processing an image signal output from an image sensing unit which includes a plurality of image sensing 
20 regions constructing one frame and a plurality of output terminals in one-to-one correspondence with the plurality of 
image sensing regions, and which outputs, from each of the plurality of output terminals, an image signal pertaining 
to image sensing in a con'esponding image sensing region and a dummy image signal concerning the con'esponding 
image sensing region, offset differences between a plurality of image signals output from the plurality of output terminals 
are reduced on the basis of a plurality of dummy image^signals output from the plurality of output temiinals. The plurality 
25 of dummy image signals are independent of electric charge obtained from photoelectric converters of the Image sensing 
unit. ^ 
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Claims 



1. A signal processing apparatus for processing an image signal, characterized by comprising: 

image sensing means (29) which comprises a plurality of image sensing regions constructing one frame and 
a plurality of output terminals in one-to-one correspondence with said plurality of image sensing regions, and 
35 which outputs, from each of said plurality of output terminals, an image signal pertaining to image sensing in 

a corresponding image sensing region and a dummy image.signat concerning the corresponding image sens- 
ing region; and ^ 

processing means (36-39) for reducing offset differences between a plurality of image signals output from said 
plurality of output terminals, on the basis of a plurality of dummy image signals output from said plurality of 
^0 output terminals, ; 

wherein the plurality of dummy image signals are independent of electric charge obtained from photoelectric 
conversion means of said image sensing nneans. 

45 2. The apparatus according to claim 1 . characterized; in that '• • 

said image sensing means (29) comprises: , " .^^i » 

a plurality of vertical transfer means (60) for vertically transferring signals generated by 61 photoelectric con- 
version means; and ^ . .. . I 
50 a plurality of horizontal transfer means (57,* 58) each for transferring signals containing signals transferred by 
a part of said plurality of vertical transfer means which belongs to one of said image sensing regions, 

wherein said plurality of horizontal transfer rrieans are fdmned in one-to-one con-espondence with said plu- 
rality of output terminals, and 

55 the plurality of dummy image signals are signals transfen-ed by said plurality of horizontal transfer means, 

except for signals transferred by said plurality pf vertical transfer means. 

3. The apparatus according to claim 1, characterized in that ^ 
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said image sensing means (29) compiises: 

a plurality of vertical transfer means (60) for vertically transferring signals generated by said photoelectric 
conversion means; and 

a plurality of horizontal transfer means (57, 58) each for transferring signals containing signals transferred by 
a part of said plurality of vertical transfer means which belong to one of said image sensing regions. 

wherein said plurality of horizontal transfer means are fomied in one-to-one correspondence with said plu- 
rality of output terminals, 

each of said plurality of horizontal transfer means comprises: 

first transfer means for transferring signals transferred by vertical transfer means belonging to one of said 
image sensing regions; and 

second transfer means formed between a con-esponding output temiinal and said first transfer means, and 
the plurality of dummy image signals are accumulated in said second transfer means before said plurality of 
horizontal transfer means start transfer. 

The apparatus according to claim 1 , characterized in that 
said image sensing means (29) comprises: 

a plurality of vertical transfer means (60) for vertically transfemng signals generated by said photoelectric 
conversion means; and 

a plurality of horizontal transfer nneans (57, 58) each for transferring signals containing signals transferred by 
a part of said plurality of vertical transfer means which belong to one of said image sensing regions, 

wherein said plurality of horizontal transfer nneans are formed in one-to-one con^espondence with said plu- 
rality of output terminals, and 

the plurality of dummy image signals are signals, except for signals transferred by said plurality of vertical 
transfer means, transferred by said plurality of horizontal transfer means after said plurality of horizontal transfer 
means have transferred signals of one horizontal line transferred from said plurality of vertical transfer means. 

The apparatus according to any one of claims 1 to 4, characterized by further comprising optical black clamping 
means (40, 41) for clamping a plurality of image signals processed by said processing means (36-39), on the basis 
of an optical black level supplied from one image sensing region of said image sensing means (29). 

The apparatus according to any one of claims 1 to 5. characterized by further comprising optical black clamping 
means (40, 41) for clamping a plurality of image signals processed by said processing means (36-39), on the basis 
of an average value of optical black levels supplied from said plurality of image sensing regions of said image 
sensing means (29). 

The apparatus according to claim 5 or 6, characterized by further comprising image synthesis means (46) for 
generating an image signal of one image by synthesizing a plurality of image signals processed by said optical 
black clamping means (40, 41). 

The apparatus according to anyone of claims 1 to 7, characterized in that said processing means (38, 39) corrects 
the gains of the plurality of image signals whose offset differences are reduced on the basis of the plurality of 
dummy image signals. 

A signal processing apparatus for processing an image signal, characterized by comprising a plurality of vertical 
transfer means (60) for transferring signals from a plurality of photoelectric conversion means (59) of a plurality of 
image sensing regions in which said plurality of photoelectric conversion means are an-anged in horizontal and 
vertical directions and which collectively construct one frame, a plurality of horizontal transfer means (57, 58) 
fonned in one-to-one con'espondence with said plurality of image sensing regions and each comprising a plurality 
of ti-ansfer stages, a plurality of output terminals (53-56) formed in one-to-one con-espondence with said plurality 
of horizontal transfer means, and processing means (36-39) for reducing ofteet differences between a plurality of 
image signals output from said plurality of output terminals, on the basis of dummy image signals output from said 
plurality of output terminals, 

wherein the dummy output signal is obtained by performing idel transfer in said plurality of horizontal transfer 
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means. 

10. The apparatus according to claim 9. characterized by further comprising optical black clamping means (40, 41) 
for damping a plurality of image signals processed by said processing means (36-39) on the basis of an optical 

5 black level supplied from one image sensing region of said image sensing means (29). 

11. The apparatus according to claim 9, characterized by further comprising optical black clamping means (40, 41) 
for clamping a plurality of image signals processed by said processing means (36-39) on the basis of an average 
value of optical black levels supplied from said plurality of image sensing regions of said image sensing means (29). 

10 ' : 7 

12. The apparatus according to any one of claims 9 to 11, characterized in that said processing means (38, 39) 
corrects the gains of the plurality of image signals whose offset differences are reduced on the basis of the plurality 
of dummy image signals. 

15 13. A signa! processing method of processing an image signal, characterized by comprising the step of reducing 
offset differences between a plurality of image signals output froni a plurality of output temiinals of image sensing 
means which comprises a plurality of image sensing regions constructing one frame and the plurality of output 
temiinals in one-to-one correspondence with the plurality of image sensing regions, and which outputs, from each 
of the plurality of output temiinals. an Image signal pertaining to image sensing in a con-esponding image sensing 

20 region and a dummy image signal concerning the corresponding image sensing region, on the basis of a plurality 

of dummy image signals output from the plurality of output terminals, wherein the plurality of dummy image signals 
are independent of electric charge obtained from photoelectric conversion means of the image sensing means. 

14. A signal processing method in a signal processing apparatus comprising a plurality of image sensing regions which 
25 comprise a plurality of photoelectric conversion means arranged in horizontal and vertical directions and which 

constnjct one frame, a plurality of vertical transfer means for transferring signals from the plurality of photoelectric 
conversion means, a plurality of horizontal transfer means formed in one-to-one con'espondence with the plurality 
of image sensing regions and each comprising a plurality of transfer stages, and a plurality of output terminals 
fomied in one-to-one correspondence with the plurality of horizontal transfer nneans, 
30 characterized by comprising the step of reducing offset differences between a plurality of image signals 

output from the plurality of output temiinals on the basis of a dummy image signal obtained by performing idle 
transfer in the plurality of horizontal transfer means, and output .from the plurality of output terminals. 

15. A computer readable program including Instructions for controlling the processing means to carry out the method 
35 of any one of claims 13 and 14. 
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